pervasive computing
ElasticAI: Creating and Deploying Energy-Efficient Deep Learning Accelerator for Pervasive Computing
Qian, Chao, Ling, Tianheng, Schiele, Gregor
Deploying Deep Learning (DL) on embedded end devices is a scorching trend in pervasive computing. Since most Microcontrollers on embedded devices have limited computing power, it is necessary to add a DL accelerator. Embedded Field Programmable Gate Arrays (FPGAs) are suitable for deploying DL accelerators for embedded devices, but developing an energy-efficient DL accelerator on an FPGA is not easy. Therefore, we propose the ElasticAI-Workflow that aims to help DL developers to create and deploy DL models as hardware accelerators on embedded FPGAs. This workflow consists of two key components: the ElasticAI-Creator and the Elastic Node. The former is a toolchain for automatically generating DL accelerators on FPGAs. The latter is a hardware platform for verifying the performance of the generated accelerators. With this combination, the performance of the accelerator can be sufficiently guaranteed. We will demonstrate the potential of our approach through a case study.
Lightweight Modeling of User Context Combining Physical and Virtual Sensor Data
Campana, Mattia Giovanni, Chatzopoulos, Dimitris, Delmastro, Franca, Hui, Pan
The multitude of data generated by sensors available on users' mobile devices, combined with advances in machine learning techniques, support context-aware services in recognizing the current situation of a user (i.e., physical context) and optimizing the system's personalization features. However, context-awareness performances mainly depend on the accuracy of the context inference process, which is strictly tied to the availability of large-scale and labeled datasets. In this work, we present a framework developed to collect datasets containing heterogeneous sensing data derived from personal mobile devices. The framework has been used by 3 voluntary users for two weeks, generating a dataset with more than 36K samples and 1331 features. We also propose a lightweight approach to model the user context able to efficiently perform the entire reasoning process on the user mobile device. To this aim, we used six dimensionality reduction techniques in order to optimize the context classification. Experimental results on the generated dataset show that we achieve a 10x speed up and a feature reduction of more than 90% while keeping the accuracy loss less than 3%.
DIY-IPS: Towards an Off-the-Shelf Accurate Indoor Positioning System
Menon, Riccardo, Lakhdari, Abdallah, Abusafia, Amani, He, Qijun, Bouguettaya, Athman
We present DIY-IPS - Do It Yourself - Indoor Positioning System, an open-source real-time indoor positioning mobile application. DIY-IPS detects users' indoor position by employing dual-band RSSI fingerprinting of available WiFi access points. The app can be used, without additional infrastructural costs, to detect users' indoor positions in real time. We published our app as an open source to save other researchers time recreating it. The app enables researchers/users to (1) collect indoor positioning datasets with a ground truth label, (2) customize the app for higher accuracy or other research purposes (3) test the accuracy of modified methods by live testing with ground truth. We ran preliminary experiments to demonstrate the effectiveness of the app.
Federated Self-Supervised Learning in Heterogeneous Settings: Limits of a Baseline Approach on HAR
Ek, Sannara, Rombourg, Romain, Portet, François, Lalanda, Philippe
Federated Learning is a new machine learning paradigm dealing with distributed model learning on independent devices. One of the many advantages of federated learning is that training data stay on devices (such as smartphones), and only learned models are shared with a centralized server. In the case of supervised learning, labeling is entrusted to the clients. However, acquiring such labels can be prohibitively expensive and error-prone for many tasks, such as human activity recognition. Hence, a wealth of data remains unlabelled and unexploited. Most existing federated learning approaches that focus mainly on supervised learning have mostly ignored this mass of unlabelled data. Furthermore, it is unclear whether standard federated Learning approaches are suited to self-supervised learning. The few studies that have dealt with the problem have limited themselves to the favorable situation of homogeneous datasets. This work lays the groundwork for a reference evaluation of federated Learning with Semi-Supervised Learning in a realistic setting. We show that standard lightweight autoencoder and standard Federated Averaging fail to learn a robust representation for Human Activity Recognition with several realistic heterogeneous datasets. These findings advocate for a more intensive research effort in Federated Self Supervised Learning to exploit the mass of heterogeneous unlabelled data present on mobile devices.
Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domain
Usmanova, Anastasiia, Portet, François, Lalanda, Philippe, Vega, German
Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. In this way, no private data is sent over the network, and the communication cost is reduced. However, current solutions rely on the availability of large amounts of stored data at the client side in order to fine-tune the models sent by the server. Such setting is not realistic in mobile pervasive computing where data storage must be kept low and data characteristic (distribution) can change dramatically. To account for this variability, a solution is to use the data regularly collected by the client to progressively adapt the received model. But such naive approach exposes clients to the well-known problem of catastrophic forgetting. The purpose of this paper is to demonstrate this problem in the mobile human activity recognition context on smartphones.
Federated Continual Learning through distillation in pervasive computing
Usmanova, Anastasiia, Portet, François, Lalanda, Philippe, Vega, German
Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current solutions rely on the availability of large amounts of stored data at the client side in order to fine-tune the models sent by the server. Such setting is not realistic in mobile pervasive computing where data storage must be kept low and data characteristic can change dramatically. To account for this variability, a solution is to use the data regularly collected by the client to progressively adapt the received model. But such naive approach exposes clients to the well-known problem of catastrophic forgetting. To address this problem, we have defined a Federated Continual Learning approach which is mainly based on distillation. Our approach allows a better use of resources, eliminating the need to retrain from scratch at the arrival of new data and reducing memory usage by limiting the amount of data to be stored. This proposal has been evaluated in the Human Activity Recognition (HAR) domain and has shown to effectively reduce the catastrophic forgetting effect.
The AI-Enabled Future
The pace of artificial intelligence continues inexorably forward. Every day we see continued development of new technologies, new applications, and greater investment in AI, machine learning, and the host of cognitive technologies. While we might be able to easily see how some of these technologies will be implemented in the short term, what does the future hold for widespread adoption of AI? In the 1980s the emergence of portable phones made it pretty obvious that they would allow us to make phone calls wherever we are, but who could have predicted the use of mobile phones as portable computing gadgets with apps, access to worldwide information, cameras, GPS, and the wide range of things we now take for granted as mobile, ubiquitous computing. Likewise, the future world of AI will most likely have much greater impact in a much different way than what we might be assuming today.
Week In Review: Auto, Security, Pervasive Computing
Huawei is also now the world's largest supplier of smartphones, surpassing Samsung Electronics Co. Qualcomm also announced a super-fast charging platform this week for Android devices that is supposed to charge a battery to 50% full in 5 minutes, and 100% full in 15 minutes. Xilinx wants to help drive open, interoperable, and adaptable Radio Access Network (RAN) 5G technologies. The company this week joined the Open RAN Policy Coalition, an organization that advocates for open and interoperable solutions in RAN. Xilinx is already a member of O-RAN alliance and is a contributor to the 3GPP specifications for 5G mobile networks. Xilinx offers silicon that supports multiple standards, bands, carriers and sub-networks for Open RAN, the company said in its press release.
The AI-Enabled Future
The pace of artificial intelligence continues inexorably forward. Every day we see continued development of new technologies, new applications, and greater investment in AI, machine learning, and the host of cognitive technologies. While we might be able to easily see how some of these technologies will be implemented in the short term, what does the future hold for widespread adoption of AI? In the 1980s the emergence of portable phones made it pretty obvious that they would allow us to make phone calls wherever we are, but who could have predicted the use of mobile phones as portable computing gadgets with apps, access to worldwide information, cameras, GPS, and the wide range of things we now take for granted as mobile, ubiquitous computing. Likewise, the future world of AI will most likely have much greater impact in a much different way than what we might be assuming today.
Dynamic Service Composition Orchestrated by Cognitive Agents in Mobile & Pervasive Computing
Automatic service composition in mobile and pervasive computing faces many challenges due to the complex nature of the environment. Common approaches address service composition from optimization perspectives which are not feasible in practice due to the intractability of the problem, limited computational resources of smart devices, service host's mobility, and time constraints. Our main contribution is the development of a cognitively-inspired agent-based service composition model focused on bounded rationality rather than optimality, which allows the system to compensate for limited resources by selectively filtering out continuous streams of data. The evaluation of our approach shows promising results when compared against state-of-the-art service composition models.